Visual management system

ABSTRACT

A process for dividing an electronic screen, such as a television or computer screen, into discrete, independently operating sub-screens includes the step of electronically linking the screen to a screen operating system. This operating system is capable of selectively dividing the screen into two or more sub-screens which support audio or visual data in an active mode simultaneously and independently. This is performed through the use of a plurality of data access lines which provide data simultaneously to the two or more sub-screens such that the data can be simultaneously accessed and manipulated in more than one sub-screen such that each sub-screen actively supports data generated from a dedicated software program. Such invention may be implemented in customized encoded hardware or a combination of hardware and software.

CLAIM OF PRIORITY

This patent application claims priority from non-provisional patentapplication, Ser. No. 10/357,565 with a filing date of Feb. 5, 2003.This application is a continuation in part of the 10/357,565 non-provisional application.

BACKGROUND OF THE INVENTION

The present invention generally relates to electronic screens, such asthose used in television sets and computer monitors. More particularly,the present invention resides in a process for dividing such electronicscreens into discrete, independently operating sub-screens which can besimultaneously manipulated and accessed.

In the past, electronic screens, such as those used for televisions andcomputers, have only supported a single active window or screen at atime. For example, even televisions with picture-in-picture capabilitieshave only one active screen which can be manipulated at any given time.Similarly, in computer monitor systems, although the computer monitorscreen may show a plurality of windows at any given time, only onewindow is active. There are instances when the computer screen can bedivided into two screens, but the contents of the two windows arecontrolled by the same software, for example, a word processing functionallowing two separate windows to be created to view two documents.However, only one of the documents can be accessed and manipulated atany given time, even in this scenario.

Accordingly, there is a need for a screen operating system which dividesan electronic screen into discrete, independently operating sub-screenswhich are independently fed data and can be manipulated through discreteaccess lines. The present invention fulfills these needs and providesother related advantages.

SUMMARY OF THE INVENTION

The present invention resides in a process for dividing an electronicscreen into discrete, independently operating sub-screens and as suchprovides split-screen technology where the additional screen sub-screensdo not override the content of the other locations or sub-screensdepending on user preference. This is performed by providing anelectronic screen, such as a computer or television screen. In oneembodiment, the screen is at least a twenty inch screen.

The screen is electronically linked to a screen operating system capableof selectively dividing the screen into two or more sub-screens withsupport visual and/or audio data therein in an active modesimultaneously and independently. This is done by creating a pluralityof data access lines which provide data simultaneously to the two ormore sub-screens. The data in the more than one sub-screen can besimultaneously accessed and manipulated through the screen operatingsystem. Thus, each sub-screen actively supports data generated from adedicated software program. Of course, it will be appreciated by thoseskilled in the art that the data can comprise visual or audio data.

Other features and advantages of the present invention will becomeapparent from the following more detailed description, taken inconjunction with the accompanying drawings, which illustrate, by way ofexample, the principles of the invention.

BRIEF DESCRIPTION OF THE DRAWINGS

The accompanying drawings illustrate the invention. In such drawings:

FIG. 1 is a diagrammatic view of an electronic screen divided intomultiple operating sub-screens in accordance with the presentinventions;

FIG. 2 is the blow up view of sub-screen with manipulability;

FIG. 3 is the flow diagram of the visual management system architecture;

FIG. 4 is the flow diagram detailing the logical architecture;

FIG. 5 is the flow diagram of the control application process;

FIG. 6 is the flow diagram of the video merge process;

FIG. 7 is the flow diagram of the input direct process flow; and

FIG. 8 is a diagrammatic view of a display screen with a partitionportion for the sub-screens.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

As illustrated in FIG. 1, the present invention resides in an electronicscreen 1, such as a computer screen, television screen, or any otherelectronic screen. In one embodiment, the electronic screen 1 is atelevision screen having a dimension of at least twenty inches. Thescreen 1 is electronically linked to a screen operating system which iscapable of selectively dividing the screen 1 into two or moresub-screens 3 with support visual and/or audio data therein in an activemode simultaneously and independently.

This is done by creating a plurality of data access lines through whichthe data is transmitted to the two or more sub-screens 3. For example,illustrated sub-screen 5 comprises a main screen, such as the screenwhich would initially appear upon turning on the television. Using thescreen operating system, and possibly key strokes or icon basedcommands, the screen operating system could be manipulated so as toprovide a secondary screen illustrated as sub-screen 3, which could haveother information, such as closed caption writing. Yet anothersub-screen, such as that illustrated as sub-screen 3, could be made inorder to support additional information, such as a ticker tape orfinancial market news. The main viewing screen 5 could be physically onescreen, but electronically split into multiple screens such that thecontent of each screen does not permanently override the other unlessthe user so designates it. Preferably, the user can selectively enlargeor reduce the size of each screen 3.

Also, in the particular embodiment, the data in each sub-screen can besimultaneously accessed and manipulated through the screen operatingsystem. Thus, each sub-screen 3 actively supports data generated from adedicated software program. In this regard, are active stock ticker tapesymbol screen, such as that illustrated in screen 7, could be activelyupdated while the user viewed a television program or conducted dataprocessing using a data processing software program as shown in FIG. 2.

Additional sub-screens do not override the content of the other sub-5screens. The data that is placed within them, icons, pictures, excelfile numbers, electronic TV guide, screen saver pictures, etc. isirrelevant just as the software used to write it whether it be Windowsbased, Linux based, or Mac based.

In fact, it is contemplated that the World Wide Web could be navigatedwhile another sub-screen supports another function. For example, whilewriting a report, a word processing program could support an individualscreen while the other sub-screen supported the navigation of the WorldWide Web. Searches could be conducted in the World Wide Web screen whiledata would be manipulated in the other screen.

One of the sub-screens could be used to support a sound system, such asa home theater sound system using icons or the like, while viewinganother screen or manipulating data in yet another screen. Thesub-screens can be reconfigured so that they support different programsor have different data imported therein. As mentioned above, the usershould be able to have the means to alter the size of the screen so thata particular sub-screen can be enlarged while others are reduced, yetstill visible or operating.

The present invention will essentially define the convergence of apersonal computer and television lending ease and functionality to WebTV and home integration networks. This also allows multi-tasking with ahierarchical structure depending on the user's visual usage importancein relation to the application relevance. Although the invention hasbeen described in relation to a television screen, as its preferredembodiment, it should be understood that the teachings of the inventioncould be applied to virtually any digital screen which would besub-divided into individual sub-screens using the screen operatingsystem described herein. The larger the screen the more viewingpossibilities become available to the user. Preferably, supplying alarger screen not only increases viewing area, but more importantlyoffers creative & interesting choices, i.e. totally diverse interactingscenarios arbitrarily chosen.

U.S. patent application Ser. No. 10/357,565 to Catanese, entitled“Process for Dividing an electronic Screen into Discrete, IndependentlyOperating Sub-Screens”, which is incorporated herein by reference.

As described in FIG. 3, the Video Display(s) component 9 is one or morevideo display device viewed by the user to interact with the videooperating system (VOS)-enabled system. The output display 9 may take anyform commonly known in the art such as, but not limited to: CRTmonitors, plasma screens, organic light-emitting diodes, flexiblecomputer displays such as e-paper, computer monitors, televisions,projection screens, and/or LCD screens. Individual sub-screens 3 may beallocated to certain video displays 9 by the user 15.

The Video Card(s) 23 component is one or more video driver hardwaredevices used to generate the video signal(s) for the Video Display(s).These are the hardware components of the VOS. The video card 23 utilizedmay also be any card commonly known in the art such as, but not limitedto: Voodoo, Radeon, and GeForce.

The installation of this software can be, but not limited to: downloadsvia the internet, installation from media or wirelessly transferred.

The VOS Meta Video Driver 29 is a software component that accepts videoDisplay Requests 27 from the applications 33 that want to display to theuser. It takes the incoming Display Requests 27 and issues DisplayRequests 27 to the underlying Video Driver software 29 according to theVideo Configuration 21. The Video Configuration 21 is modified by theUser 15 via the VOS Configuration Application or by other means such asconfiguration files or other application interfaces. The VOS Meta VideoDriver and the VOS Application are the software components of the VOS,however may be encoded into hardware form.

The software core component of the VOS is the Meta Video Driver 29. Toapplications it appears to be just another video driver, and to theunderlying video drivers, it appears to be an application. In this way,the VOS Configuration Application can allow the user to seamlessly andeasily interact and manipulate applications across various hardware andvisual presentation configurations.

Capabilities of the VOS Configuration Application include the ability totake any video display request and reposition, rescale, adjust color,combine with other requests, etc. Additionally it has the capability tocreate it's own display requests and to interact with otherapplications. An example of this would be where a configurable icon baris presented to the user in a VOS-controlled portion of the screen. Thisicon bar is used to control other applications within the primary videodisplay. A more sophisticated implementation would allow the user tointeractively select a portion of the primary display to be presented inanother display. With this functionality, a user could select thenews-ticker portion of a video feed from one window and display justthat part of that video feed in another display.

The Applications 33 may display video inputs from various sources suchas internal programs, external programs and external video sources. Inthis deployment, the VOS provides the capability to flexibly split andmanage the available applications to provide the user with a multiplevideo source experience 3. Since the VOS system acts as a normal videodriver for the applications, they do not need to be changed to takeadvantage of the advanced screen manipulation operations implemented bythe VOS.

The VOS Configuration Application can also get its input from internaland external interfaces. This lets it manipulate the display accordingto user input from other applications, direct input from the user orfrom external controllers, limited only by the hardware and externalsoftware support.

The VOS may also be embodied primarily in hardware. This may beimplemented by creating custom hardware components for the VideoDisplay(s) 9 and/or the Video Card(s) 23.

In the Video Display(s) 9 custom hardware implementation, the imagepresented to the user 15 is be implemented by multiple video displayunits 9 that comprise a single visual experience to the user. Forexample the user may be presented with a primary video display unit(such as CRT or flat panel) with an additional smaller display unitalongside the primary one to display iconic or other information to theuser.

In the Video Card(s) 23 custom hardware implementation, the VOS MetaVideo Driver 29 and the Video Driver 25 components are merged.Additionally appropriate portions of the VOS Meta Video Driver 29functionality are implemented inside the Video Card(s) 23. For exampleprocessing-intensive video operations such as scaling and screendivision would be implemented by the hardware instead of the driversoftware, thus offloading the work from the host CPU onto the videohardware.

These Video Display(s) 9 and Video Card(s) 23 may be used together tocreate sophisticated visual configurations where a single Video Card 23may be used to drive several display components together. For example,using the appropriate set of video cards and supporting hardware, avideo wall of 9 flat-screen displays could be combined with a LED-arrayscrolling display to present an integrated visual experience to a largeaudience, all controlled by one VOS Application.

As described in FIG. 4, the central part of the VMS architecture is theDisplay Map 41. The Display Map 41 is the internal representation of howvideo sources 22 are arranged on the video hardware. One or more VirtualDisplays 19-20 are managed by the Control Application 39 inside theDisplay Map 41.

The Control Application 39 allows the user to manipulate the Display Map41. It takes care of initializing the Display Map 41 at system startup,and saving it at system shutdown. It provides a user interface to theUser 15 from which the user 15 can manage the display layout. It letsthe user split displays and move and manipulate visual components andapplications from one Virtual Display 19-20 to another.

Each application or Interactive Video Source 22 interacts with its ownVirtual Display 19-20 which it considers to be its own. The Video Merge43 uses the Display Map 41 to translate the Virtual Displays 19-20 intoone set of operations sent to the video driver(s) 25. Likewise, theInput Redirector 37 takes User Input 17 and sends it to the appropriateVirtual Display 25 interface that each Application or Interactive VideoSource 22 gets its input 17 from.

As described in FIG. 5, the Control Application allows the user tomanipulate the Display Map 44. It takes care of initializing the DisplayMap at system startup, and saving it at system shut down.

The Initialization process begins by reading display configuration data47 from a file or other data source. It then creates the Display Map 49internal data structures and starts the Video Merge 51 and InputRedirector services 53. Once internal initialization is complete, itregisters with the Operating System 55 to let it know that it is readyto handle input and display requests.

Once initialized, the Control Application processes displayreconfiguration requests 57 from user input 17. It does this by matchingthe request with the current state of the Display Map, and updating theDisplay Map 61 as necessary to fulfill the request. If the change to theDisplay Map requires a change in display 63, it updates the Video Mergeprocess with the required changes.

At system shut down, the Control Application deregisters 65 itself fromthe operating system, saves the display configuration data 67 from theDisplay Map, and then shuts down the Video Merge 69 and Input Redirectorprocesses 71.

As described in FIG. 6, the Video Merge process takes the variousDisplay Requests 73 from the Applications and Interactive Video Sourcesand translates them for display on the video hardware.

Its processing consists of first, getting each Display Request 73. Itthen looks up the context of the Application 75 in the Display Map todetermine what transformations are required. It implements thosetransformations 77 on the original Display Request, which includeoperations such as resizing or clipping. The transformed Display Request79 is then passed on to the Video Driver that actually displays theinformation. For example an application in Virtual Display A wants todisplay an image bounded by rectangle with X, Y coordinates of 50, 150by 200, 250. That Virtual Display is positioned on the actual display atbase coordinate with an offset of 55, 55 and a reduced scale of 50%. Thetransformed display result sent to the Video driver is a rectangularimage composed from the original image reduced in size by 50% andbounded by coordinates of 80, 130 by 155, 180.

As described in FIG. 7, the Input Redirect process takes input requests81 and sends the input requests to the appropriate Application.

The Input Redirect processing consists of first, reading the next InputRequest 81 from the Operating System. It then looks up the context ofthe request in the Display Map 83 to determine what transformation isnecessary and which Application(s) is(are) to receive the input. Afterthe lookup, the appropriate transformation 85 is applied and thetransformed request is sent to the appropriate Application 87. Forexample, if a mouse device is clicked at X,Y position 100, 250 and theDisplay Map says that Virtual Display A contains that location, but isscaled down 50%, then display A receives that mouse click at position200, 500.

As described in FIG. 6, conventional video displays 89 may bemanufactured with physical partitions 93 which can separate sub-screens3 from the main viewing screen 91.

While the above invention has been described with reference to certainembodiments, the scope of the present invention is not limited to theseembodiments. One skilled in the art may find variations of thesepreferred embodiments which, nevertheless, fall within the spirit of thepresent invention, whose scope is defined by the claims set forth below.

1. A process for dividing an electronic screen into discrete,independently operating sub-screens, comprising the steps of: providingan electronic screen; electronically linking the screen to a screenoperating system capable of selectively dividing the screen into two ormore sub-screens which support visual and/or audio data therein in anactive mode simultaneously and independently; creating a plurality ofdata access lines for providing data simultaneously to the two or moresub-screens; and simultaneously accessing and manipulating the data inmore than one sub-screen through the screen operating system, whereineach sub-screen actively supports data generated from a dedicatedsoftware program.
 2. The process of claim 1, wherein the electronicscreen comprises a television screen.
 3. The process of claim 2, whereinthe television screen is at least a 20 inch television screen.
 4. Theprocessing of claim 1, including the step of selectively engaging orreducing in size a sub-screen.
 5. The process of claim 1, wherein thedata comprises visual or audio data.
 6. A process for dividing anelectronic screen into discrete, independently operating sub-screens,comprising the steps of providing a television screen; electronicallylinking the screen to a screen operating system capable of selectivelydividing the screen into two or more sub-screens which support visualand/or audio data therein in an active mode simultaneously andindependently, wherein each sub-screen actively supports data generatedfrom a dedicated software program; creating a plurality of data accesslines for providing data simultaneously to the two or more sub-screens,wherein the access lines are capable of simultaneous conveyance of datato respective active sub-screens; selectively enlarging or reducing insize a sub-screen; and simultaneously accessing and manipulating thedata in more than one sub-screen through the screen operating system,wherein each sub-screen actively supports data generated from adedicated software program;
 7. The process of claim 6, wherein thetelevision screen is at least a 20 inch television screen.
 8. The methodof visual management comprising: starting up various softwareapplications on a computer; selecting such applications; sizing suchportioned applications; and arranging a sizing such applications on apredetermined location on the visual output.
 9. The method of visualmanagement comprising: starting up various software applicationsinstalled onto a computer(s); selecting components of such applications;sizing such portioned applications; arranging such applications on apredetermined location on the visual output; and fixing the position ofthe user selected components.
 10. The method of visual management as inclaim 9 in which such that application positioning is stored at anypoint in time during the usage of the computer, and re-instituted aftereach reboot.
 11. The method of visual management as in claim 9 in whichuser viewing may be done on a multiple of output devices.
 12. The methodof visual management as in claim 9 in which centralizing all customsized application within an access bar.
 13. The method of visualmanagement as in claim 9 in which displaying the access bar only oncertain user designated device(s)
 14. The method of visual management asin claim 9 allowing the user to place overlays on the screen to coverportions of the viewing display.
 15. The method of visual management asin claim 9 in which resizing the application's viewable display todetermine the number of scroll bars necessary to scroll through theoutput.
 16. The method of visual management as in claim 9 in whichdefining the shape of the application's viewable by the user.
 17. Themethod of visual management as in claim 11 in which predetermining thepositions of the application can be across a multiplicity of outputdevices.
 18. The method of visual management as in claim 9 in whichplacing all user selected applications into a predetermined informationbar designated for such applications.
 19. The method of visualmanagement as in claim 18 in which the information bar has a scrollingeffect to allow the user to view all applications
 20. The method ofvisual management as in claim 19 in which the scrolling functionalitycan be controlled by the user.
 21. The method of visual management as inclaim 9 in which starting applications are automatically initiatedamongst applications selected for the customized computer interface. 22.The method of visual management as in claim 9 in which manipulating thesoftware applications within the predetermined positions.
 23. The methodof visual management comprising: selecting various software applicationson a computer; sizing such applications; arranging such applications ona predetermined location on the visual output; fixing the position ofthe user selected components; and allocating a particular fixed view ofthe applications.
 24. The method of visual management as in claim 20 inwhich viewing the portion of the application where real time changes canbe observed by the user.
 25. The method of visual management ofarranging software using an information bar comprising: placing userdetermined applications within the information bar; determining by theuser the size, shape and placement of such information bar; allowing theuser to view real time changes to all applications within theinformation bar; and re-occuring static positioning of the informationbar upon each reboot of the computer.
 26. The method of visualmanagement as in claim 25 in which a scrolling effect is utilized toallow viewing of multiple applications in a relatively small portion ofthe output device.
 27. An apparatus for employing a visual managementsystem comprising: at least one computer; at least one input device incommunication with the computer(s); at least one visual output devicereceiving data from the computer(s); and a visual operating system. 28.An apparatus for employing a visual management system as in claim 27 inwhich one of the output device is a computer monitor(s).
 29. Anapparatus for employing a visual management system as in claim 27 inwhich one of the output device is a television(s).
 30. An apparatus foremploying a visual management system as in claim 27 in which one of theoutput device is a projection screen(s).
 31. An apparatus for employinga visual management system as in claim 27 in which one of the outputdevice is a plasma screen(s).
 32. An apparatus for employing a visualmanagement system as in claim 27 in which the computers are networked.33. An apparatus for employing a visual management system as in claim 27in which centralized control of all networked computers can be achievedthrough one user designated computer.
 34. An apparatus for employing avisual management system as in claim 27 in which the output device(s)are networked to a computer system.
 35. An apparatus for employing avisual management system comprising: at least one visual output device;at least one input source transferring data to the output device; atleast one physical partition on the display screen of the output device;and at least one partition utilized as the information bar.
 36. Anapparatus for employing a visual management system as in claim 35,wherein the physical partition is angled out of the screen.
 37. Anapparatus for employing a visual management system as in claim 35,wherein physical partition obtrude from the rest of the screen
 38. Anapparatus for employing a visual management system comprising: at leastone visual output device; at least one input source transferring data tothe output device; at least one display screen of the output device; andat least one partition utilized as the information bar.
 39. An apparatusfor employing a visual management system comprising: at least onecomputer; at least one input device in communication with thecomputer(s); at least one visual output device receiving input from thecomputer(s); and a visual operating system encoded onto a graphics card.40. An apparatus for employing a visual management system comprising: atleast one computer; at least one output device in communication with thecomputer(s); at least one input device in communication to thecomputer(s); at least one software application installed on thecomputer(s); at least one software application selected to participatein the visual management system; at least one display map to organizedsaid software application(s); and at least one control application toallow user management of such software application(s).
 41. An apparatusfor employing a visual management system comprising: at least onecomputer; at least one output device in communication with thecomputer(s); at least one input device in communication to thecomputer(s); at least one software application installed on thecomputer(s); at least one software application selected to participatein the visual management system; at least one display map to organizedsaid software application(s); at least one control application to allowuser management of such software application(s); and at least oneredirector to allow at least one input device to control a particularsoftware application(s) in the visual management system.
 42. Anapparatus for employing a visual management system comprising: at leastone computer; at least one output device in communication with thecomputer(s); at least one input device in communication to thecomputer(s); at least one software application installed on thecomputer(s); at least one software application selected to participatein the visual management system; at least one meta video driver tomanage software applications in the visual management system; at leastone user defined video configuration for applications in the visualmanagement system; and at least one configuration application interfacewhich allows the user to interact and manipulate software applications.43. An apparatus for employing a visual management system as in claim42, wherein the configuration application allows the user to repositionsoftware applications.
 44. An apparatus for employing a visualmanagement system as in claim 42, wherein the configuration applicationallows the user to rescale software applications.
 45. An apparatus foremploying a visual management system as in claim 42, wherein theconfiguration application allows the user to intermix softwareapplications.
 46. An apparatus for employing a visual management systemas in claim 42, wherein the configuration application allows the user toportion out software applications.
 47. An apparatus for employing avisual management system as in claim 42, wherein the configurationapplication allows the user to adjust colors of software applications.48. The method of visual management comprising: booting the computer;accessing the configuration data; creating a display map; merging videoinputs; and initializing the input redirector.
 49. The method of visualmanagement comprising: booting the computer; accessing the configurationdata; creating a display map; merging video inputs; initializing theinput redirector; registering user reconfiguration request(s); accessingthe current display configuration; updating the display map; andreinitialize output display based on the user input.
 50. The method ofvisual management comprising: booting the computer; accessing theconfiguration data; creating a display map; merging video inputs;initializing the input redirector; registering user reconfigurationrequest(s); accessing the current display configuration; updating thedisplay map; reinitialize output display based on the user input; andsaving all visual management configurations.
 51. The method of visualmanagement as in claim 50, wherein merging video inputs comprising:obtaining video output request from software applications; determiningthe context of such software application in relation to a display map;and transforming the video output as dictated by the display map. 52.The method of visual management as in claim 51, wherein merging videoinputs comprising: obtaining user inputs; and redirecting such inputs tothe appropriate corresponding software application.
 53. An apparatus foremploying a visual management system as in claims 38, 39, 40, 41, or 42in which the output device is television(s).
 54. An apparatus foremploying a visual management system as in claims 38, 39, 40, 41, or 42in which the output device is plasma screen(s).
 55. An apparatus foremploying a visual management system as in claims 38, 39, 40, 41, or 42in which the output device is computer monitor(s).
 56. An apparatus foremploying a visual management system as in claims 38, 39, 40, 41, or 42in which the output device is CRT monitor(s).
 57. An apparatus foremploying a visual management system as in claims 38, 39, 40, 41, or 42in which the output device is projection screen(s).
 58. An apparatus foremploying a visual management system as in claims 38, 39, 40, 41, or 42in which the output device is LCD screen(s).
 59. An apparatus foremploying a visual management system as in claims 38, 39, 40, 41, or 42in which the output device is organic light-emitting diodes(s).
 60. Anapparatus for employing a visual management system as in claims 38, 39,40, 41, or 42 in which the output device is flexible computerdisplay(s).